﻿Extensive amounts of knowledge and data stored in medical databases require
the development of specialized tools for accessing the data, data analysis,
knowledge discovery, and effective use of stored knowledge and data, since the
increase in data volume causes difficulties in extracting useful information for
decision support. The traditional manual data analysis has become insufficient,
and methods for efficient computer-based analysis indispensable, such as the
technologies developed in the area of Data Mining and knowledge discovery
in databases (Frawley, 1991).
Knowledge discovery in databases is frequently defined as a process
(Fayyad, 1996) consisting of the following steps: understanding the domain,
forming the data set and cleaning the data, extracting of regularities hidden in
the data thus formulating knowledge in the form of patterns or models (this step
is referred to as Data Mining (DM)), postprocessing of discovered knowledge,
and exploiting the results.
Important issues that arise from the rapidly emerging globality of data and
information are:
the provision of standards in terminology, vocabularies and formats to
support multi-linguality and sharing of data,
rn standards for the abstraction and visualization of data,
a standards for interfaces between different sources of data,
integration of heterogeneous types of data, including images and signals,
and
reusability of data, knowledge, and tools.
Many environments still lack standards, which hinders the use of data analysis
tools on large global data sets, limiting their application to data sets collected
for specific diagnostic, screening, prognostic, monitoring, therapy support or
other patient management purposes. The emerging standards that relate to
Data Mining are CRISP-DM and PMML. CRISP-DM is a Data Mining process
standard that was crafted by Cross-Industry Standard Process for Data Mining
Interest Group (www.crisp-dm.org). PMML (Predictive Data Mining Markup
Language, www.dmg.org), on the other hand, is a standard that defines how to
use XML markup language to store predictive Data Mining models, such as
classification trees and classification rule sets.
Modem hospitals are well equipped with monitoring and other data collection
devices which provide relatively inexpensive means to collect and store
the data in inter- and intra-hospital information systems. Large collections of
medical data are a valuable resource from which potentially new and useful
knowledge can be discovered through Data Mining. Data Mining is increasingly
popular as it is aimed at gaining an insight into the relationships and
patterns hidden in the data.
Patient records collected for diagnosis and prognosis typically encompass
values of anamnestic, clinical and laboratory parameters, as well as results of
particular investigations, specific to the given task. Such data sets are characterized
by their incompleteness (missing parameter values), incorrectness (systematic
or random noise in the data), sparseness (few and/or non-representable
patient records available), and inexactness (inappropriate selection of parameters for the given task). The development of Data Mining tools for medical diagnosis and prediction was frequently motivated by the requirements for
dealing with these characteristics of medical data sets (Bratko and Kononenko,
1987; Cestnik et al., 1987).
Data sets collected in monitoring (either acute monitoring of a particular
patient in an intensive care unit, or discrete monitoring over long periods of
time in the case of patients with chronic diseases) have additional characteristics:
they involve the measurements of a set of parameters at different times,
requesting the temporal component to be taken into account in data analysis.
These data characteristics need to be considered in the design of analysis tools
for prediction, intelligent alarming and therapy support.
In medicine, Data Mining can be used for solving descriptive and predictive
Data Mining tasks. Descriptive Data Mining tasks are concerned with finding
interesting patterns in the data, as well as interesting clusters and subgroups of
data, where typical methods include association rule learning, and (hierarchical
or k-means) clustering, respectively. In contrast, predictive Data Mining starts
from the entire data set and aims at inducing a predictive model that holds on
the data and can be used for prediction or classification of yet unseen instances.
Learning in the predictive Data Mining setting requires labelled data items.
Class labels can be either categorical or continuous; accordingly, predictive
tasks concern building classification models or regression models, respectively.
Data Mining in medicine is most often used for building classification models,
these being used for either diagnosis, prognosis or treatment planning.
Predictive Data Mining, which is the focus of this chapter, is concerned with
the analysis of classificatory properties of data tables. Data represented in the
tables may be collected from measurements or acquired from experts. Rows in
the table usually correspond to individuals (training examples) to be analyzed
in terms of their properties (attributes) and the class (concept) to which they
belong. In a medical setting, a concept of interest can be a disease or a medical
outcome. Supervised learning assumes that training examples are classified
whereas unsupervised learning concerns the analysis of unclassified examples.
This chapter is organized as follows. Section 2 presents a selection of symbolic
classification methods. Section 3 complements it by outlining selected
subsymbolic classification methods. Finally, Section 4 concludes with a brief
outline of other methods for supporting medical knowledge discovery.